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Advanced Data Systems Division 


ABSTRACT 


This report describes the implementation and performance 

evaluation of a class of Rate j , systematic, convolutional 

codes being decoded with a simple majority logic decoder. The en- 
coding logic appends one parity bit for each PCM telemetry word 
(typically 7 to 10 bits for NASA applications). It is shown that over 
the critical range of received PCM telemetry signal- to-noise ratios, 
this coding procedure produces a net coding gain of from 1.5 to 2.5 db 
relative to an equal power transmission of uncoded PCM telemetry. 
Being a low- redundancy systematic code, it is also possible to pro- 
cess this data without convolutional decoding if one is willing to incur 
a small rate loss penalty of about 0.5 db. The report suggest that this 
class of code be considered for NASA missions where a moderate 
increase in system gain is desirable. 


Preceding page blank 


iii 







BLM « NO* Fn*® 


CONTENTS 


INTRODUCTION 

SYSTEMATIC, RATE CONVOLUTIONAL CODES, 

EVALUATION OF CODING PERFORMANCE 

SUMMARY 


Page 


1 

4 

7 

11 


APPENDIXES 


Appendix Page 

A CALCULATION OF DECODER BIT ERROR RATE 13 

B LISTING OF FORTRAN PROGRAM FOR THE 


PERFORMANCE EVALUATION OF SYSTEMATIC, 

RATE X ) » CONVOLUTIONAL CODES 17 

C TABULATION OF CODING PERFORMANCE OF 

SYSTEMATIC, RATE > CONVOLUTIONAL 

CODES FOR M = 2 TO 11 19 


Preceding page blank 


v 



ILLUSTRATIONS 


Figure Page 

1A Systematic Encoder 2 

IB Non- Systematic Encoder 2 

2 Majority Logic Decoder for a Rate 1/2 Systematic Code 3 

3 A Systematic Rate 8/ 9 Convolutional Encoder 5 

3B Systematic Rate 8/9 Convolutional Decoder 6 

4 Comparison of Bit Error Rate Versus S/N Ratio 

for Coded and Uncoded Telemetry 9 

5 Coding Gain for Rate ( M Convolutional Codes 10 


vi 



PERFORMANCE 

RATE 


EVALUATION OF A CLASS OF SYSTEMATIC, 
M - 1 \ 
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, CONVOLUTIONAL CODES 


INTRODUCTION 

Convolutional coding is finding increased acceptance as a means of im- 
proving spacecraft telemetry performance. The earlier uses of convolutional 
codes in NASA deep space projects could be considered virtually a matter of 
necessity since a brute force solution by an increase in power, system gain 
and/ or bandwidth was not technically feasible. In these cases the increase in 
system performance via the coding gain was therefore reluctantly accepted. 

More recently convolution coding is being implemented on other NASA satellites 
such as RAE-B and IMP-l/J where the deliberate choice of convolutional coding 
was not taken out of a sense of desperation but was made because it represented 
the most cost-effective solution and the problem. Traditionally, the communi- 
cations designer has had to juggle the basic resources of power, system gain, 
and bandwidth into a system design with acceptable performance characteristics. 
Often the designer is faced with a dilemma that the resources that are con- 
venient to allocate do not match the requirements and that to add the next in- 
crement of resources sufficient for required performance is unduly expensive. 
Convolutional codes are a viable tool that may permit a stretching of the 
resource to meet these performance requirements in a cost effective manner. 

Convolutional codes and decoding devices run the gamut from extremely 
complex and operationally cumbersome techniques with high coding gain to 
simple and easily implemented techniques with low to moderate coding gain. 

Most of the information theory literature treats the former case and very little 
attention has been given to the simpler techniques which offer more modest 
coding gain. This report discusses one class of code which do offer simple 
encoding and decoding implementation and operability. Although the coding 
gain is modest, typically only 1.5 to 2.5 db, this class of code has many poten- 
tial applications in NASA projects. To put the average achievable coding gain 
of 1.9 db into proper perspective it should be noted that the equivalent improve- 
ment could be achieved by: 

(1) Increasing the spacecraft transmitting power by 55% or 

(2) Replacing an 85 foot antenna dish with a comparably equipped 106 foot 
dish. 

Certainly the latter alternative is very unpleasant to contemplate and the former 
item may be equally impractical under some conditions. Thus one should not 



sneer at improvements in the order of 1.9 db, especially if one is coming out 
slightly on the short side in the circuit margin calculations. 

All convolutional codes used by NASA to date have been rate 1/ M binary 
codes in which a binary signalling alphabet is used and M bits are transmitted 
for every information bit. By far the most common type of convolutional code 
is the rate 1/ 2 code. The code is systematic if one of the sub-bit stream im- 
bedded in the overall encoded bit stream represents the information bits in an 
undistorted form. Otherwise the code is nonsystematic. Figure 1A, B show a 
simple example of a rate 1/ 2 systematic and nonsystematic encoder respectively. 


INFORMATION 

SEQUENCE 



ENCODED INFORMATION 

SEQUENCE SEQUENCE 



EXCLUSIVE OR OPERATION 



ENCODED 

SEQUENCE 


Figure 1A. Systematic Encoder 


Figure IB. Non-Sy stematic Encoder 


With most convolutional codes, the encoding technique is relatively straight 
forward and easy to implement. This is fortunate because, for many NASA ap- 
plications, it is the encoding equipment which must reside in the spacecraft. 

A much greater variety of decoding techniques and equipment exist ranging 
from the very simple to the extremely complex. In general you get what you 
pay for with the operational complexity going up rapidly with each db of im- 
provement in coding gain. Figure 2 illustrates a very simple majority logic 
decoder for the systematic encoding algorithm shown in Figure 1A*. 

In this report a class of systematic, Rate j , convolutional codes 

will be described. In these codes one parity bit is generated for each telemetry 
word. Since a telemetry word typically contains between seven and ten bits for 
most NASA missions, the reduction in signal energy per information bit is 
minimized. The performance evaluation contained in the latter portion of this 
report will compare convolutional coding performance versus uncoded perfor- 
mance on the basis of equal transmitted signal power. Therefore since more 

* 

With all the techniques described in this report it is assumed that bit and character syn- 
chronization have been achieved prior to the convolutional decoding process. This can be 
done by conventional frame synchronization techniques. 
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INFORMATION 



Figure 2. Majority Logic Decoder for a Rate 1/2 Systematic Code 


bits are transmitted in the coded case, the signal energy per bit and signal-to- 
noise ratio must necessarily decrease relative to the uncoded case. This loss 
is referred to as the rate loss and is tabulated below for word lengths from 2 
to 12. 


mgth (bits) 

Code Rate 

Rate Loss (db) 

2 

1/2 

3.01 

3 

2/3 

1.76 

4 

3/4 

1.24 

5 

4/5 

0.96 

6 

5/6 

0.79 

7 

6/7 

0.67 

8 

7/8 

0.58 

9 

8/9 

0.51 

10 

9/10 

0.46 

11 

10/11 

0.41 

12 

11/12 

0.38 


The rate 1/ 2 encoding and decoding scheme illustrated in Figures 1A and 2 
respectively is not a cost effective means of improving telemetry performance. 
The reason for this is that the scheme requires the transmission of one parity 
bit for every information bit; therefore, the transmitted energy per bit is re- 
duced by 50% from an uncoded transmission. The simple coding scheme shown 
in this illustration does not possess sufficient gain to overcome this initial 3 db 
handicap. 
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SYSTEMATIC, RATE )* CONVOLUTIONAL CODES 

Figures 3 A and 3B illustrate the encoder and decoder respectively of a 
Rate 8/9 convolutional code. In Figure 3A an 8-bit word is received from the 
spacecraft telemetry multiplexor and each bit is shifted into the corresponding 
entrance stage of eight shift registers. Each shift register has 9 stages. The 
telemetry word is shifted down one stage each bit time, and after nine such 
shifts it is dumped into a parallel to serial converter and is then modulated on 
the telemetry link. Note also that as each individual bit is being shifted down 
the shift register it will pass through two stages which are shaded in Figure 3A. 
Each word time a parity bit is generated which is the Modulo 2 addition (Exclu- 
sive OR) of the contents of all 16 stages which are shaded in this diagram. 

This parity bit is transmitted as the 9th bit of each telemetry word. 


At the decoder end (shown in Figure 3B) the telemetry data is bit-, word-, 
and frame- synchronized and the 9-bit parallel output of the word synchronizer 
is input to 9 nine- stage shift registers. A parity bit (P GEN ) is generated from 
the information bits in exactly the same manner as in the encoder. If no errors 
occur in transmission, the P GEN bit will be identical to the received parity bit 
(Prec ) a t each word time. If P GEN © P EEC = 1 then the received and generated 
parity bits differ and this is symptomatic of transmission error(s). To identify 
the location of the error the output of the parity compare circuit (P © P Dirr . ) 
is gated into a syndrome shift register. If only one error has occurred within 
the data currently stored in the shift registers, and if this is an information bit, 
then, when the bit in error reaches the bottom stage of the shift register, S 0 
will be 1 and one and only one of the other syndrome stages S _ x through S _ 8 
will also be set to 1. This syndrome stage (S_ to S_ 8 ) which is set uniquely 
identifies the information bit in error and permits the flipping of the appropriate 
bit to correct the error. This decoder cannot correct all combination of errors 
but it will be shown that, over a broad range of signal-to-noise ratios, a net 
coding gain is achievable. Figures 3A and 3B can be easily extrapolated for 
any other word length. 
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*PARITY BIT (P) IS THE MODULO 2 ADDITION OF ALL SHADED BITS 
Figure 3A. Systematic Rate 8/9 Convolutional Encoder 
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P GEN = LOCALLY GENERATED PARITY REPRESENTING MODULO 2 ADDITION 
OF ALL RECEIVED BITS IN SHADED STAGES OF SHIFT REGISTERS. 



Figure 3B. Systematic Rate 8/9 Convolutional Decoder 
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EVALUATION OF CODING PERFORMANCE 


The probability of an error out of the telemetry bit synchronizer/ detector 
is expressed as: 


£ 


1 

2 erfc ( 


/"(SNR) • (RATE) 


( 1 ) 


where 


£ = pre-correction bit error rate 


SNR = Equivalent signal-to-noise ratio for uncoded PCM telemetry 

expressed as a linear ratio (rather than a logarithmic ratio as 
in Decibels) 

RATE = Coding rate (RATE = 1 for uncoded PCM and (M - 1)/M for 
coded PCM telemetry) 


erfc (x) = 1 


- 2 -f 

Vtt Jo 


e“ y dy 


In the case of convolutionally encoded telemetry, the post-correction bit 
error rate, E, can be expressed as 


E 


P + 

u c 


f c 


(3) 


where 


P uc = probability or an uncorrectable error, and 
P fc = probability of false correction. 

To evaluate P uc and P f it is necessary to understand the combination of con- 
ditions which give rise to both phenomena. This analysis is described in Ap- 
pendix A. From Equations A-l and A-2 we have 


2 - (1 - £) 


1 t M 2 

2 ( M 


+ 3M - 2 ) 


- (1 - E> 


m- i y 


(4) 


P 


f C 


M 2 e ( 1 - e) M " 




t E • (1 - E) M “ 2 


(5) 


7 



The post-correction bit error rate, E, may be found by substituting (4) and (5) 
into (3) and solving for E by iterations. 

A FORTRAN program was written to evaluate the performance of this class 
of code. The program listing is shown in Appendix B and the resulting com- 
puter printout is contained in Appendix C. 

Figure 4 is a graph of the effective bit error rate versus S/N ratio for 
uncoded PCM telemetry and for convolutionally coded PCM telemetry at rates 
2/3, 3/4, 4/5, 6/7, 8/9, and 10/11. Note that the convolution coding performance 
crosses the uncoded performance curve between 5.0 db and 6.4 db. At signal- 
to-noise ratios above this cross-over range, the convolutional codes give superior 
performance. This cross-over range corresponds to an uncoded bit error rate 
between 1.5 x 10' 3 and 6 x 10~ 3 and is too high for normal telemetry processing. 

Figure 5 illustrates the coding gain (or loss) in decibels for convolutionally 
encoded PCM versus the uncoded case. This coding gain includes the previously 
mentioned rate loss effect. For most telemetry applications, the maximum 
acceptable bit error rate is 10 -4 which corresponds to an uncoded S/N ratio 
of 8.4 db. Above 12 db the bit error rate is so low even for uncoded telemetry 
that any further improvement via coding is generally unwarranted. A Rate 8/9 
convolutional code will provide coding gains of 1.5 db and 2.3 db at signal-to- 
noise ratios corresponding to uncoded telemetry reception at 8.4 db and 12 db 
respectively. The average coding gain over this critical range is 1.9 db. 
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BIT ERROR RATE 




CODING GAIN (DB) RELATIVE TO UNCODED TELEMETRY 
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SUMMARY 


The class of systematic, Rate > convolutional codes using simple 

majority logic decoding possess the following features which may prove bene- 
ficial to some NASA spacecraft or ground communication application: 


(1) Coding gain (including rate loss effect) between 1.5 and 2.5 db relative 
to uncoded PCM transmission over the critical range of signal-to-noise 
ratios. 

(2) Low redundancy which minimizes the rate loss effect and conserves 
spectrum allocation. 

(3) Extremely simple encoding and decoding logic which can provide a low 
cost reliable coding implementation. 


From an information theory basis, there may appear to be little benefit in 
minimizing the amount of coding redundancy. It can usually be shown that with 
sophisticated decoding techniques, the coding gain obtainable with high redundancy 
codes more than compensates for the rate loss effect. Why, then, should we 
attempt to minimize the coding redundancy? One reason is that not all stations 
or mission support facilities are similarly equipped at any given point in time. 
Decoding equipment, even of the simple majority logic variety described in this 
report, may not be available at a facility for which mission support is desirable. 

If a nonsystematic code were used there is no hope of analyzing the data prior 
to decoding. If a high redundancy systematic code is used then the reduced 
signal-to-noise ratio due to the rate loss may make the reliability of the infor- 
mation sub-bit stream so low as to be unusable. For example, the rate losses 
for rate 1/2 and rate 1/3 codes are 3.0 db and 4.8 db respectively. However, 
in the case of a rate 8/9 convolutional code, the rate loss is only .5 db. There- 
fore, if a requirement exists to process a rate 8/9 telemetry bitstream at a 
facility without a convolutional decoder, the resulting bit error rate is only 
degraded by 0.5 db relative to an uncoded PCM transmission. 

Another application may be in the area of PCM telemetry transmission of 
scanned image data. Here it is convenient to encode an entire scan line, which 
may consist of up to 100,000 bits, into one minor telemetry frame. A severe 
synchronization problem occurs due to the very long interval between frame 
sync words. A simple word parity scheme has been suggested to provide an 
additional aid to synchronization. The same objectives could be achieved using 

a systematic, Rate f— — — ^ , convolution code with the added benefit that a 

coding gain relative to the word parity scheme of 2 to 3 db would be possible. 
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There is no intent in this report to suggest that Rate — j convolutional 

codes are a universal panacea to the various PCM telemetry design problems 
related to NASA mission. For many applications the S/N ratio is so good that 
even simple coding techniques are not warranted. On the other hand severe 
power/bandwidth constraints may necessitate coding gains far higher than are 
obtainable with this class of code. However, between these two extremes 
there lies a broad range of applications where a consideration of systematic 

Rate -) convolutional codes may prove cost-effective. 
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APPENDIX A 


CALCULATION OF DECODER BIT ERROR RATE 


For a — — — convolutional code of a type similar to that shown in 

Figures 3A and 3B, the S 0 syndrome stage will be a 1 if and only if an odd 
number of bit errors in the transmission of the following bits: 

S 0 : P 0 , (0, 1), (0, 2), (0, 3) ... (0.M-1), (1, 1), (2, 2), (3, 3) . . . (M-l, M-l) 


In the above notation P L refers to the parity bit transmitted with the ith 
word and (i, j) represent the jth information bit of the ith worth. Similarly the 
entire set of errors which could give rise to any non zero syndrome bits are 


S 0 : 

Po- 

(0, 1), 

(0, 2) .. 

(0.M-1), 

(1. 1). 

(2, 2) ... 

(M-l.M-1) 

S-r 

P-i- 

(-1. 1). 

(-1, 2) ... 

• (" 1, M- 1), 

(0, 1), 

(1. 2) ... 

(M-2, M-l) 

s -r 

P-2’ 

("2, 1), 

(-2, 2) .. 

■ (-2.M-1), 

(-P 1). 

(0, 2) ... 

(M-3, M-l) 


S_ N : P_ N> (— N, 1), (-M, 2).. 

. (-N, M-l), (1-N, 1), (2-N, 2) .. 

. (M-N- 1, M- 1) 

S 1-M : P 1~M’ (1-M, 1), (1-M, 2) .. 

. (1-M, M- 1), (2-M, 1), (3-M, 2) . . 

(0.M-1) 


In the above matrix, there are two distinct classes of potential error terms. 
The first class, referred to as the pre- correction class, represent those errors 
for which no correction is attempted (parity bits) or those information bits 
which have not yet reached the stage where they can be corrected. The proba- 
bility that any one of these bits in the pre- correction class will be in error is 
simply equal to the bit error rate from the bit detector. The second class 
represent the post- correction elements and refers to those information bits 

which have already been decoded. There are a total of i (M 2 + 3M) distinct 

pre-correction elements and (M - l) 2 distinct post-correction elements in the 
above matrix. 
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A decoder error will be made if either: 


(1) The decoder fails to correct an actual information bit error, or 

(2) The decoder erroneously changes the state of a properly received 

information bit. ' 

Let P uC and P fc be the probabilities of an uncorrectable error and a false 
correction error respectively. 

uncorrectable error will occur in a given information bit position if an 

The information bit is initially received in error, and, 

A received error occurs in any one of the other i (M 2 + 3M - 2) pre- 

z 

correction elements or the (M - l) 2 post correction element and 
virtually all multiple combinations thereof. 

Thus 


An 
only if: 

( 1 ) 

( 2 ) 


P 


U C 


€ 



O 


(RT + 3M-2) 


(1 - e )( m_1 > 2 


(A-l) 


False correction will occur on the jth bit of word 0 if: 

(1) The jth bit is initially received correctly, 

(2) The S 0 and S_j stages of the syndrome register are set to 1, and, 

(3) All other syndrome stages are reset to zero. 

From the matrix of pre- and post- correction elements it can be seen that the 
number of ways the above constraints can be satisfied is a function of the bit 
position "j" as well as M. Evaluating this probability gives: 


Pfc (j) - M • € 

+ (M - 1) 


(1 - e) M • [(M - j)e • (1 - e) M ~i _1 
E • (1 - E) m ' 2 ] + (M - 2)e • (1 - e) M “ 2 


(A- 2) 
E • (1 - E) m " 2 


14 



P fc will be approximated by setting j = M/2. Thus 


f C 




(A-3) 


+ E • (1 - E) M ~ 2 • 


M • (M - 1) + (M “ 2)( 1 - e 



But 


M • (M - 1) + (M - 2) (1 - e)~ 2 ~ M 2 


for e « 1, Hence, 


P fc ~ M 2 e • (1 


£) n 


; _ i 


(1 - e) 2 + E • (1 - E) 


M- 2 


(A-4) 


The decoder error rate, E, can now be found by setting E equal to the sum of 
(A-l) and (A-4) and iterating until the solution for E converges. 
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APPENDIX B 

LISTING OF FORTRAN PROGRAM FOR 
THE PERFORMANCE EVALUATION OF 
SYSTEMATIC, RATE J, CONVOLUTIONAL CODES 


Preceding page blank 
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APPENDIX C 


TABULATION OF CODING PERFORMANCE 
OF SYSTEMATIC, RATE 
CONVOLUTIONAL CODES FOR M = 2 TO 11 
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